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Abstract —This paper deals with the prohlem of estimating 
the delays and amplitudes of a weighted superposition of pulses, 
called stream of pulses. This prohlem is motivated hy a variety of 
applications, such as ultrasound and radar. This paper shows that 
the recovery error of a tractable convex optimization problem is 
proportional to the noise level. Additionally, the estimated delays 
are clustered around the true delays. This holds provided that 
the pulse meets a few mild localization properties and that a 
separation condition holds. If the amplitudes are known to be 
positive, the separation is unnecessary. In this case, the recovery 
error is proportional to the noise level and depends on the 
maximal number of delays within a resolution cell. 

I. Introduction 

In many engineering and scientific problems, the acquired 
data is comprised of a weighted super-position of pulses 
(kernels). Typically, we aim to decompose the stream of pulses 
into its building blocks, frequently called atoms. Ultrasound 
imaging EtII . Il28l and Radar ||2l function as representative 
examples. In these applications, a pulse is transmitted and its 
echoes are reflected from different targets and recorded. 

Mathematically, we consider the model 

y[/c] — ^ ^ ^m] “f Cjn € M, (I-l) 
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finding. An alternative way is to utilize compressed sensing 
and sparse representations theorems, relying on the sparsity 
of the signal (e.g. M, ini). However, these fields cannot 
explain the success of ii minimization or greedy algorithms 
as the dictionaries have high coherence. 

Inspired by recent advances in the theory of super-resolution 
m, HD, M, il, 0, Q, m, hi, M, we employed a 
convex optimization framework based on the existence of in¬ 
terpolating polynomials, frequently called the dual certificate. 
In the next section, we elaborate on the convex optimization 
framework, and reveal the fundamental conditions, enabling 
stable decomposition of stream of pulses. Section [111] presents 
our main theorems. Particularity, we show that the solution of 
a convex optimization problem results in a stable and localized 
decomposition of stream of pulses under a separation condition 
if the pulse satisfies some mild localization properties. In the 
non-negative case, i.e. Cm > 0, the separation is unnecessary 
and can be replaced by a weaker condition of Rayleigh regu¬ 
larity. We present all the results and the relevant definitions for 
a univariate stream of pulses, however we stress that similar 
results also exist for bivariate stream of pulses. Ultimately, 
Section IV concludes the work and suggests future extensions. 


where gcr[k] := g[k/(7] is a sampled version of the producing 
kernel g{t) with a sampling spacing of 1/N, namely g[k] := 
g{k/N), and K := {km}- We assume that the error term is 
bounded ||n||i := with no additional statistical 

assumptions. Later on, we will also consider a positive stream 
of pulses, where the amplitudes are assumed to be positive 
Cm > 0. The acquired data can be presented as a spike 
deconvolution problem, i.e. 

y[k] = {ga * x) [k] -b n[k], 

where denotes a discrete convolution, and 

='^CmS[k- km]- ( 1 - 2 ) 
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The aim of this paper is to suggest a stable approach to 
decompose the stream of pulses into its atoms by solving a 
tractable convex optimization program. 

A well-known approach to decompose the signal into its 
atoms is by using parametric methods, such as MUSIC, 
matrix pencil and ESPRIT (23), lEa, ioi, M- However, 
these methods tend to be unstable in the presence of noise 
or model mismatch due to sensitivity of polynomial root 


H. Convex optimization approach for 

DECOMPOSITION OF STREAM OF PULSES 

In this paper we focus on a convex optimization approach 
for decomposing a stream of pulses in a noisy environment. 
We use the Total-Variation (TV) norm as a sparse-promoting 
regularization. In essence, the TV norm is the generalization 
of £i norm to the real line (for rigorous definition, see for 
instance ED). Eor discrete measures of the form ( jlLlj ), we 
have 11T11 TV = J2m \^rn,\- The framework is based on a duality 
theorem, frequently called the dual certificate, as follows 0: 

Theorem II.l. Let 

x{t) ='^CmSt„,{t), Cm G K, T := {fm} C K, (II.l) 

m 

and let y(t) = J^g{t — s)dx (s) for a L times differentiable 
kernel g(t). If for any set {vm} £ there exists a 

function of the form 

Jr 



for some measures {/i^ satisfying 

|g(i)| <l,VieM\r, 


then X is the unique real Borel measure solving 

min llillry subject to yit) = / g(t — s)dx{s). 

ieMiR) Jr 


(11.3) 


Proof: Let i be a solution of (II.3 i, and define x = x + h. 
The difference measure h can be decomposed relative to |a;| 
as 

h = fix T hxc , 



Gaussian := e 2 

Cauchy := 

Co 

1.22 

1 

Cl 

1.59 

1 

C2 

2.04 

2 

C3 

2.6 

5.22 

IPW) 

-1 

-2 

empirical u 

1.1 

0.45 


TABLE I 

The table presents the nume rical constants of the global 

PROPERTY IN DEFINITION IIII. 1 I FOR THE GAUSSIAN AND CAUCHY 

kernels. Additionally, we evaluated by numerical experiments 

THE MINIMAL EMPIRICAL VA LUE O F U, THE SEPARATION CONSTANT OF 
DEFINITI0N |III.2I F0R each KERNEL. 


where hx is supported in T, and hxc is supported in 
(the complementary of T). If hx = 0, then also hx<= = h = 
0. Otherwise, ||a;||Ty > ||a^||Ty which is a contradiction. If 
hx f 0, we perform a polar decomposition of hx 


hx = \hx\sgn{hx), 

where sgn{hx) is a function on K with values { — 1,1} (see 
e.g. mi). By assumption, for any 0 < £ < L 

f g^^\t - s)dx (s) = [ g^^\t - s)dx (s), 

JR Jr 

which in turn leads to g^^'i {t — s)dh (s) = 0. Then, for any 
q of the form (|II.2|l we get 


(g,h} = [ q(t)dh{f) 

JS. 

= f '^dge{s) [ g^^\s-t)dh{t) 

Jr _Q Jr. 


= 0 . 


By assumption, for the choice Vm = sgn{hx (tm)), there 
exists q of the form ( |II.2[ ), such that 

\qit)\ < 1, Vf G R\T. 

Consequently, 

0 = {q, h) = {q, hx) + {q, hxc) = \\hx\\xv + (<7, hxc) . 


which is a contradiction. Therefore, h = 0, which implies that 
X is the unique solution of (II.31. ■ 

In practice, we cannot solve the infinite dimensional convex 
optimization problem (II.31. Hence, we assume that the signal 
lies on a grid with spacing of 1/N which can be as fine 
as desired. In this case, the TV minimization lini ) reduces 
to standard £i minimization that can be solved by many 
existing solver. The solution of the discrete problem converges 
to solution on the continuum (in the sense of measures) as 
the discretization becomes finer 1^ . The behaviour of the 
solution in high SNR regime is analyzed in ca, in. 


III. Main results 

As aforementioned, the problem of decomposing a stream 
of pulses can be reduced to the construction of an interpolating 
function, comprised of the kernel g{t) and its derivatives. The 
existence of such function relies on two interrelated pillars. 
First, the kernel should satisfy some localization properties, 
as follows: 

Definition III.l. A kernel g is admissible if it has the following 
properties: 

1) g G (K), is real and even. 

2) Global property: There exist constants Ci > 0,£ = 
0,1,2,3 such that (f)| < Ci/(^l + t^) , where 
g^^'i (t) denotes the derivative of g. 

3) Local property: There exist constants s,/3 > 0 such that 

a) g{t) > 0 for all \t\ < e and g{t) < g{e) for all 

|t| > e, 

b) (f) < —(3 for all |f| < e. 


If hxc = 0, then H/itHtu = 0, and h = 0. Alternatively, if 
hxc 0, from the second property of q, 

I (?> hxc) I < ||/iTc||Ty. 

Thus, 

\\hxc\\xv > \\hx\\ TV- 


As a result, using the fact that x has minimal TV norm, we 
get 

lla^llry > \\x + h\\xv = \\x + hx\\xv + \\hxc\\xv 
> ||2;||Ty - ll^rllTy + \\hxc\\xv > lla^Hry, 


Two typical examples for admissible kernels are the Gaus- 

(2 

sian kernel g{t) = e~^ and the Cauchy kernel g{t) = 
as presented in Table 

The second pillar is a kernel-dependent separation condi¬ 
tion, as follows: 


Definition III.2. A set of points K CL 1, is said to satisfy the 
minimal separation condition for a kernel-dependent y > 0 
and a given N,a > Q if 


min I ki 

ki,kjGK,ki^kj 


kj I > vaN. 


















In 13, Q we proved that if the kernel g is admissible and 
the signal’s support satisfies the kernel-dependent separation 
condition, then there exist constants {um} and {hm} such that 
a function of the form 


Definition III.5. We say that the set V C C M 

is Rayleigh-regular with parameters {d, r) and write V € 
r) if every interval {a,b) C K of length p,{a,b) = d 
contains no more that r elements ofV: 


^ ^ ttjjigfjlt tra) “t” 9^ ^ if 


satisfies the interpolation requirements of Theorem II. 1 


X = Er 


k — kr, 


and K := 


{fcm}- If 


\V n (a, b)\ <r. 


Hence, by Theorem II. 1 the £i minimization (assuming that the 
signal lies on the grid) recovers x exactly from y. Additionally, 
the existence of the interpolating function is the key for 
proving the robustness and localization of the solution in 
a noisy environment. These results are summarized in the 
following theorem: 

Theorem III.3. Consider the model (0 for an admissible 
kernel g. Let us denote the solution of 

mmj ||i||j^ subject to ||y — ffo-* i|| i < 


Equipped with Definition |III.5| we state the main theorem 
for the non-negative case. This result implies that the recovery 
error is proportional to the noise level 6, and depends expo¬ 
nentially in the signal Rayleigh regularity r. 

Theorem III.6. (0? Consider the model o with Cm > 0 
for an admissible kernel g satisfying g(t) > 0. Then, there 
exists u > 0 such that if supp(x) G {va,r) and Na > 


(I) 




the solution x of the convex problem 


min subject to \\y — go- * x\\i d, x > 0, 


K satisfies 


the separation condition of Definition \III.2\ for N,a > 0, then 
(for sujficiently large u) 


satisfies (for sujficiently large v) 
2 ( 2 ’' - 1 ) / 


32C'n 




(III.2) 




(III.l) 


where 7 := max|A^(T, e ^}. Additionally, if e > e := 
\J C 2 +PD have the following localization properties: 

1) For any km G K, if Cm > 
25D 2 ^1 + max | then there exists 


km G K such that 


h — h 


< Na 


2 D 2 S 

Di 

{\cm\- 2 SD 2 

1 -1- max ■ 

ft 4 C 2 1 

\)) 



2) 

where 
Di : = 

Do : = 


{ G A": I fcm - fc,i I > tVECT.Vfc„ G tf} 




45 ( 0 )’ 

(3|g(2)(0)|i.2-7r2C2) + 






1 + 


(3 |p(2)(0)| ^2 _ 7r2C'2) (3p(0)i/2 - 27r2C'o) 
Remark III.4. A tighter estimation of (|///.7|l can be found in 

m- 


In many applications, the underlying signal 0 is known 
to be non-negative, i.e. Cm > 0. For instance, in single¬ 
molecule microscopy we measure the convolution of positive 
point sources with the microscope’s point spread function CD, 
©, Go). It has become evident that in this case the separation 
is unnecessary and can be replaced be the weaker condition 
of Rayleigh regularity, defined as follows: 


where 7 := max {A^tr, £ ^}. 


Remark III.7. A tighter estimation of {III.2\ can be found in 

m- 


IV. Conclusion 

In this work we have shown that a standard convex op¬ 
timization program can decompose a stream of pulses into 
its building blocks. In the general case (i.e. Cm G K), we 
have shown that the solution is robust in a noisy environment 
and that its support is clustered around the support of the 
sought signal. This holds provided that the convolution kernel 
g is sufficiently localized and a kernel-dependent separation 
condition holds. 

In the non-negative case, we have proven that the separation 
condition can be replaced be a weaker condition of Rayleigh 
regularity. The recovery error in this case is proportional to 
the noise level and depends on the signal’s regularity. It is 
essentially important to derive the localization properties in 
this case as well. 

The model presented in this work suits many practical 
applications where a signal is observed through a convolu¬ 
tion kernel (typically, the point spread function of a sensing 
device). In previous work a, we applied our algorithm for 
estimating the reflectors in in-vitro ultrasound experiments. 
The experiments showed promising results that corroborate 
our theoretical findings. It is of great interest to examine these 
theoretical results across more applications, particularly in the 
field of computational imaging. 
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